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1. Introduction 


In this paper small deterministic Turing machines with one bi-infinite tape and 
one scanning head are considered. Let DTM(m,n) denote the class of all such ma- 
chines with m tape symbols (including the blank) and n states (excluding the halting 
state). It is known that there exist universal Turing machines in DTM(5,6) [10] and 
in DTM(4,7) [4]. It is also known that the halting problem for all machines from 
DTM(1i,n) and DTM(m,1) is decidable. The first fact is trivial whereas the second 
one has been shown in [2]. In [4,5] it is mentioned that the halting problem for 
DTM(2,2) is decidable too; however without giving any proof and stating only [5] 
that this result is unpublished and unpublishable. In such a state it remained since 
1961 or 1972, respectively, until 1988. By a reduction to few cases it was possible to 
solve the problem and bring it into a publishable form. A first version can be found 
in [1]. At that time the results from 1975 [6] stating the halting problem to be decid- 
able for DTM(2,2) and DTM(2,3) have not been known to the authors. In that paper 
a completely different method was used. Neither were known the results by [7] stat- 
ing that there are universal Turing machines in DTM(2,24), DTM(3, 11), DTM(5,5), 
DTM(6,4), DTM(10,3), and DTM(21,2). All these results were only little known in 
Western countries before 1991. 

It is also shown that the sets accepted by machines from DTM(2,1) are regular, 
and that those accepted by machines from DTM(3,1) are regular too, except one case 
giving a deterministic linear context-free language which is essentially the nonregular 
language L = {a"b" | 1 <n}. 

The languages accepted by machines from DTM(2,2) are also regular, except one 
case (up to symmetries) giving essentially the same language as in the exceptional case 
of DTM(3,1), namely a deterministic linear context-free language. Thus, the halting 
problem is decidable for DTM(2,2). To obtain this result several symmetries are used 
to reduce the number of machines to consider. Finally, also a machine from DTM (4,4) 
is presented accepting a context-sensitive language, essentially L = {af | k = 2",0<n}. 
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Possibly, similar methods can be applied also to DTM(3,2), DTM(2,3), and perhaps 
to DTM(3,3). But for the last case, probably the aid of an automatic system should 
be used. 


2. Definitions 


Let T be any Turing machine with one bi-infinite tape, one scanning head, an alpha- 
bet V of m symbols including the blank, and a set S of n states (excluding the halting 
state H). The set of movements is given by {L,M,R}, standing for movement to the 
left, no movement, and movement to the right, respectively. The set of instructions, 
or program P of T, is denoted by PCS x V x V x {L,M,R} x S, with its elements 
(p,x, y,1,q) written in the form pxylq. For shortness, y,1,q if y = x, I = M,q = p, is 
omitted, respectively. If the halting state H appears, this is always understood as pxH, 
i.e. pxxMH. If T is a deterministic Turing machine P represents a (total) function. 

The class of all such deterministic Turing machines will be denoted by DTM (m,n). 
Only such machines will be considered here. 

As usual, V* denotes the free monoid generated by V, À its neutral element (the 
empty word), /g(w) the length of a word weEV*, are rev(w) its reversal (mirror image). 

Let ®V and V® stand for the set of all left-infinite and right-infinite words over 
V, respectively. 

A configuration of T is any bi-infinite word a(7)B € @V-(V xS)-V™ denoting the 
fact that the head is scanning x and T is in state p. As usually, a(7)B 5 UAG means 


that there exists a finite sequence of Turing steps from a(*) B to G )6, including 0 
steps and q=H. It is assumed that there is no continuation of any configuration y(}))6. 
Finally, let Nọ denote the set Ny := {ie N|O0<i<k}. 
As for acceptance, there exist several possibilities to define sets of words accepted 
by Turing machines. The first one just gives the set of all such bi-infinite words being 
configurations which lead to acceptance. 


Definition 1. Loo(T,p) = {a(*)BE°V-(V xS) V” | WE WV WEVAyEV : a(%)B 
+ y(ğ)ô}. 


A second possibility is the use of the work space for acceptance. Note, that by this 
definition one gets only context-sensitive languages. 


Definition 2. 
L,(T, p) 
= {u( Joe V* (V xS). V* |SKENVIEN, Ju; 0) EV *¥ Ax; € Vap;ES: 
ugo = u A vo = v A xo =x A po = DA pk = H A lg(uivi) = Ig(uv) 


M. Kudlek! Theoretical Computer Science 168 (1996) 241-255 243 


AViEN, — {k} : (» ZHAN u(*) vi Uj (e ou) 
pl Pi+1 


NYEN uy = AEN: oy =A}. 


Thus, /g(uv)+ 1 is exactly the work space for accepting u(*)v, and this word is the 
relevant part of the initial configuration being scanned by the head. 
From this definition trivially follows that 


Lemma 1. L..(T,p) = ®V -L,(T,p)-V%. 

A third possibility is not to look onto the relevant part of one initial configuration 
only but to consider them in some global sense, namely that if w is a word of the set 
then no proper subword of it is also contained in the set. 


Definition 3. 


LAT, p) = fu) V*¥-(V xS)-V*¥|Wae MV VBEV™ : 


al) VBE Loo(T,p) A (u = yu! = 3y EV : y'u ¢ Le(T,p)) 


Aw = vz => Az’ EV: v7 L.(7.p))} : 


This set is called the core of L,,(7, p). Trivially again, it follows that 
Lemma 2. L,,(7,p) = @V-L(T, p)-V™. 


Finally, the normal definition of an accepted set can be defined by cutting off all 0’s 
at left and right ends from words in L,(T, p). 


Definition 4. Lo(T, p) = {0}*\L,(7, p)/{0}* 


In the sequel it is assumed that V =N% — {k}, and that 0 represents the blank. It is 
easy to establish the following lemmas. 


Lemma 3. If there is no occurrence of pxH in the set of instructions of a Turing 
machine T, then L..(T, p) = Ls(T, p) = LCT, p) = Lo(T, p) = b. 


Lemma 4. For deterministic Turing machines it suffices that there is at most 1 
occurrence of halting qxH in the set of instructions. 


Proof. Among all occurrences of halting in P choose one, e.g. qxH. Replace all 
other pyH by pyxMgq. Then it is trivial to see that the accepted languages remain the 
same. 
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Definition 5. Let T = (S,V,P) be any deterministic Turing machine. Let x: S — S be 
any permutation of the set of states S,o: V — V be any permutation of the alphabet 
V, and u : {L,M,R} — {L,M,R} be defined by (L) = R, (M) = M, p(R)=L. 

Then define also n(T) := (S,V,x(P)) with n(p)xyln(q) E€ n(P) & pxylq €P, 
o(T) := (S, V,o(PP) with po(x)o(y)lq € o(P) & pxylq EP, and u(T) := (S, V, uW(P)) 
with pxyu(])q E€ uP) & pxylq EP. 


By the next lemma all Turing machines with movements of the head in one direction 
only can be eliminated from further consideration. 


Lemma 5. Let T be any DTM with movements only {M,R} or {L,M} in the set of 
instructions, respectively. Then L;(T, p) is regular. 


Proof. Let the movements be {M,R}, and the initial configuration «(*) 8. Then, from 
T, a finite automaton is constructed: F, :=(V,S x V;{(3)}.{(?) |ayH € P},R) with 
RCS x V} x (V U {A}) x (S x V) given by (C) G)) € R if pyzMgq €P, and 
((%).2,(5)) ER if pyzRq € P. By this construction it is obvious that L,(7,p) = 
(5) L(F x). 

Trivially, in the case of {Z,M} one gets L,(7, p) = rev(L(Fx))- 1G) 


A stronger lemma is the following one. 


Lemma 6. If either 


Vx EVV peS dm, ne N Yu E€ V” Yum EV" 3yeV IqESU{H} wEV": 


or 


YxeVYpES3m,neNYu EV" Yu EV" 3yEV 3qESU{H} we V": 


(JC) 


where during the computation the head never leaves the workspace of length m+n+1, 
then L,(T, p) is regular. 


Proof. By constructing a finite automaton with (G ) U2, G) ER or (C ), Ti CE R 
and final states (7) where # = rev(v), respecting the initial part in front of or behind 


CG) for the initial configuration. 


Although there exist deterministic Turing machines with all accepted sets L,(T, p), 
L.A(T, p), Lo(T,P) being different, only the first possibility will be considered in the 
sequel. 
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3. DTM(1, n) 


Any Turing machine T from DTM(1,n) can be considered as a finite directed graph 
with n+ 1 nodes from SU {H}. For each peéS it is decidable whether there exists a 
directed path from p to H, and this path has a length of at most n. Thus one gets 


Theorem 1. A/I sets accepted by Turing machines from DTM(1,n) are finite, and the 
halting problem for DTM(\,n) is decidable. 


4. DTM(2, 1) 


Generally, it has been shown by Herman [2] that the halting problem of arbitrary 1 
state DTMs with 1 head and 1 k-dimensional tape is decidable. He also proved that 
there exist accepted sets which are not regular. 

Let S = {p} and V = {0,1}. Then 


Theorem 2. All sets accepted by machines from DTM(2,1) are regular, and the 
halting problem for DTM(2,1) is decidable. 


Proof. Let o be the symmetry defined by o(0) = 1, o(1) = 0, and y that one defined 
by w(L) = R, (M) = M, (R) = L. By Lemma 4 it suffices to have at most 1 
possibility of halting in the program. Let there be exactly one. It also suffices that this 
is plH for if it is pOH then this may be treated using the symmetry o. The case pOL 
may be ruled out using the symmetry u. Thus, only 2 cases remain: 


The first one gives a regular set, the second one finite sets. O 


5. DTM(3, 1) 


Let S = {p}, V={0,1,2}, and f(p,x)EV, g(p,x)€{L,M,R}, h(p,x) eS U {H} 
denote the new symbol, the head movement, and the new state, respectively, if T is 
in state p and x the scanned symbol. 

By Lemma 5, and using the symmetry yp, similarly to DTM(2,1), it suffices to 
consider only the case 
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In the case f(p,0) = f(p,1) = 0 one gets as accepted set 


L,(T, p) = 2(0U 1)* (2) U (7 )s2u200 1)* (rou F ; 


in the case f(p,0)=0, f(p,1)=1 


0 1 2 
L;(T, p) = 20* 1*2 ` 
EP B x 9 j & 


in the case f(p,0) = f(p,1) = 1 


0 0 1 2 
L;(T, p) = 20* 10* 0U1)*2 0U1)*2 ; 
oo a x (a) ee ox ee d 


and in the last case f(p,0) = 1,f(p,1)= 0 the following accepted set: 
L(T, p) = jo" -+.10™ P 1™0---012, 
P 
m m, m 0 n n, 
2071101 --. 10™ 170---01"0, 
P 
201... 10% (7) 17'0--- 0170, 
P 
101... 10™ (o) 10... 01012] 
P 


k>0,mEN,m EN) 


a) 


Clearly, this is a linear deterministic context-free language not being regular. Thus: 


Theorem 3. Ail sets accepted by machines from DTM(3,1) are regular except one 
case (up to symmetries) yielding a linear deterministic context-free language. The 


halting problem for DTM(3,1) is decidable. 


6. DTM(Q, 2) 


At first some methods reducing the number of machines to be treated are considered. 
Let S = {p,q} and V = {0,1}. In the program of a Turing machine T let f(s,x)EV, 
g(s,x)€{L,M,R}, h(s,x)€SU{H} denote the new symbol to be written, the movement 
of the head, and the new state, respectively, if T is in state s and the head is scanning x. 
By Lemma 4 let there be exactly 1 possibility of H. Thus, from originally 134 = 28561 
only 4-12? = 6912 machines are left. Using Lemma 5, this number can be reduced to 


3072. 
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Using the symmetries o and u from DTM(2, 1) and x defined by 2( p) = 9,2(q) = p, 
the following reductions decrease the number of Turing machines to be considered. 


Lemma 7. It suffices to have only h(q,1) =H as halting. 


Proof. By using the symmetries o,z, and or = no. O 
By the next lemma g(q,0) = L is eliminated. 
Lemma 8. It suffices to have only g(q,0) =M or g(q,0)=R. 
Proof. By using the symmetry u. O 
The following one fixes p as initial state. 
Lemma 9. It suffices to have p as initial state. 
Proof. Let q be initial state. Then there are 2 cases to be considered, namely hA(q,0) 
= q and h(g,0) = p. The first case yields machines from DTM(2,1) which have been 
considered already. Let therefore h(g,0) = p with f(q,0) =z. 


If g(q,0) = M then let y be the deterministic gsm-mapping defined by the finite 
automaton 


(r U(V x S), {4,B}, {A}, {B}, f[aaa(7) () 5.58 Ixe v}) 
with initial state A and final state B. Then 


Z 1 
L(T,4) = 7 {| L,(T, Vx Ve F 
ORS ( (RBIN G) ) j (3) 


If g(q,0) = R then let 6 and ¢ be deterministic gsm-mappings defined by the finite 
automata 


(r U(V x S), {4,B,C}, {4}, {C}, {acct PEZ C) C,CxC |xe r\) 
with initial state A and final state C, and 

(v U(V x {p}), {4,B}, {A}, {B}, fa (%) 8.28 Ixe v} 
with initial state Æ and final state B. Then 


L(T.q) = (‘) ELAT, p)N (V x {p})- V*) 


Urev (ô (rev (L(T,p)N V*z(V x {p})V*))) U G) 


where rev denotes the mirror image. O 
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Thus, the following cases remain to be considered: h(q,0) = p with g(g,0) =M or 
9(q,0) = R, and with h( p,0) = h(p,1) =q or h(p,0) = p,h(p, 1) =q or A(p,0) =q, 
h( p, 1) = p. h(p,0) = A(p, 1) = p trivially can be ruled out. 

The next reduction eliminates h(q,0) = q. 


Lemma 10. It suffices to have h(q,0) = p only. 


Proof. If h(q,0) = q then, starting with p, all configurations ending in q yield regular 
sets since this is effectively a machine from DTM(2, 1). After reaching q this is again 
such a machine yielding regular sets only. O 


Thus, after eliminating the case g(p,0) = R,g(p,1) = L,g(qg,0) = M by the sym- 
metry u, the following cases remain (omitting f and A): 


with the possibilities for A(p,0) and h( p,1) mentioned above. This leaves 6-3-4-2 
= 144 machines from originally 4 - 12? = 6912. 

The first case to consider is 

Case 1: g(q,0) =M by the possibilities for h( p,0) and A( p, 1). 

Case 1.1: h(p,0) = h(p,1) = q. Then 


of Mro z (7 9" fpo, 
i( (reo sH 

Do o) Fa) 
(ye sæ (e) fæn( a 
1 1 

Chire) + 


Case 1.1.1: f(q4,0) = 0. Then 


0\ . (0 
(5) + (p) £0700 


(Jos ren(?) is (o) reo if f(p.1)=0, 


) 

P 
) 

P 
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(joa ren(9) +H if f(p,1)=1. 
P P 


which shows no effective movement to the right, thus yielding a regular set. 
Case 1.1.2: f(g,0) = 1. Then 


0\. /1 ; D> 
5, 0> fp, f f(p,0)=0, 
(7) (fe PE uo) a 


O\ . fi * : 
0 > 0) >H if ,0)=1, 
() (senor i 100 


(Jos nnn) 


which shows no effective movement to the left, thus also yielding a regular set. 
Case 1.2: h(p,0) = q,h(p,1) = p. Then 


(5) — (no (40) tn 
(°)- (non 
(J-e) 
(J-e) 


Case 1.2.1: f(q,0) = 0. Then 


0\ . /0 
o(p) Š (3) f(p,0) 


LAT. p)= 10" (9) U ior (7) 1*0 if f(p,1) = 9, 
P P 


and 


L,(T, p) = 10* (a) U (o if f(p,1)=1. 


Case 1.2.2: f(q,0) = 1. Then 


0\. 1 a) 
= > ae 1 
(9) Cre 0) > f(p ( A 


and the machine has no effective movement to the left, thus yielding a regular set. 


250 M. Kudlek I Theoretical Computer Science 168 (1996) 241-255 


Case 1.3: h(p,0) = p, h(p,1) =q. Then 
0 0 
0 = 0), 
GPG 
(0-0 
P P 
(o-ren) > = Fe, (TEP), 
P q 
1 l 
— A — H. 
(a)ren) 


Case 1.3.1: f(q,0) = 0. Then 


(Coren) > (e gay 
P P Pp 


This gives no effective movement to the right, thus yielding regular sets. 
Case 1.3.2: f(q,0) = 1. Then 


(pren) 


0 1 
L,(T,p) = 10* 0*1 *i if ,0) =0, 
(Tp) (°) u) if f(p,0) 


LT, =10°(°) (jos if 0) =1. 
(T,p) 5 U # if f(p,0) 


Now the 120 remaining machines are considered with 
Case 2: g(q,0) = R 


Case 2.1: g(p,0) = g(p, 1) =L 
Case 2.1.1: h(p,0) = Ko = 


Q-Q» 


yielding no halt at all. 


Case 2.1.2: h(p,0) = p, h(p,1) = 4 or h(p,0) = q, h(p,1) = p. Let m € {0,1} 
and n = 1 — m such that h( p,m) = p and h(p,n) = q. Then 


O-o 
(7) = (0) sm ror 


and 
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(J-a 


giving no effective movement to the right, and thus only regular sets. 
Case 2.1.3: h(p,0) = h(p,1) =4 


oC) E (1) fay) = 70q,0( 7 ”?), 
P q P 
(2) 5 (o»>n 

P q 


giving no effective movement at all, and thus only regular sets. 

For the remaining 2 subcases the following considerations give a further reduction 
of the number of cases. 

Let j € {0,1} be such that g(p,j) = L and k = 1 — j. If A(p,j) = q then there is 
no effective movement to the left since 


(2) Gen raa (2P), 
AO (IPD) ae ao ye 
() Cine) es a 


k ; 
ie p- A 5) if g(p,k) =R 


thus giving only regular sets. Therefore, h(p,j) = p has to be considered only. 
If h(p,k) = p then the machine will never halt. Thus assume A(p,k) = q. 
Case 2.2: g(p,k) =M. Then 


fd = j : 
j a C) S(p j) 
n 
(2 ) 5 ( View 5 OLG SA o(/ =) if f(p.k) =0, 
P P q P 
k 0 y 
WE (5) í 09.0)() í 


(a) = GED- (ena i fensi, 
¢ p) PD q) IPD H if f(p,k)=1 


OO a 


yielding effectively a machine from DTM(2,1) with only regular sets. 
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Thus 
Case 2.3: g( p,k)=R may be assumed such that the following cases remain: g(p, /) 


=L,h(p,j)= p, g(p,k)=R,h(p,k)=q,g(4,0)=R,h(q,0)= p with j, f(p.7), f(p,*), 
f(q,0) € {0,1} and k # j. This leaves 16 Turing machines to consider. 

At first 

Case 2.3.1: f(p,j) = 1 one has 


Fae a 
—> l, 
eo 
14 as G) = senfa) — H, 
P P q 
(Jo = for(i a fobsan(? J; 
p q P 
k 

(*) 0k = sok?) = sobran } 


P 


yielding as accepted sets 


L(T, p) = kj* - ) U (o ULUT, p) 
P P 
with 


LT, p) = (*) (0k)*0j if f(q,0) =k or (f(q,0) = j and f(p,k) = k), 


LT, p) = kj” (*) (Ok)"Oj if f(q,0) = f(p,k)=j 


being all regular. 
Case 2.3.2: f(p,j)= 0. Here one has 


G) -Ge 

P P 

(y> (Fo reol- fonsa (?), 
(2 \a— (S) son) sonsa n(*), 


a o) ‘) 
(fo sof) feren”), 
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e ) on si fon (ok 3 Fobra (S ] 
P q P 


(n(n 


Case 2.3.2.1: f(q,0) =k. This yields as accepted sets 


0 1 
L,(T,p) = io*( Jor H 0t1)*1 if k=1, 
(7p) ( . U p (071) 1 i 
(Geo) rong) ero 
L,(T,p) = U0 1*0U01 (01*0)*1 if k=0 
P P P 


being all regular. 


253 


Case 2.3.2.2: f(q,0) = j. Here all 4 remaining machines have to be considered. 


j=0: L,(T,p)= Ce B) (01)*1 


jJ=1,f(p,0)=0: 


L,(T, p) = ((°) U0(11)* ((FJou nui(7))) (0(0U 1))"1 


all being regular. 


The only remaining machine, with j = 1, f(p,0) = 1 however, does not yield a 
regular set but 


LAT. p) = foan" om (11)™ e 


P 0(00)™ 1(00)"' v; - - - vz—ı(00)™01, 


1 


OM aaa sinc ) 009" 0-4 (00)"01, 


— 


OLL) uy_y + uy (11) ($ Jaoor ioon; +++ DR_1(00Y" 1, 
P 
m, m 0 n n 
01(11)™*ug—1 ++ u (11) A (00)"' v1 +- vx—1(00)™1 | 
k>0,m; >0,n; >0, (ui = 0, v; = 1) or (ui = v = on} . 


It is easy to see that this set is not regular but a linear deterministic context-free 
language being similar to that one from D7TM(3,1). 
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Summarizing, one obtains 
Theorem 4. All sets accepted by Turing machines from DTM(2, 2) are regular except 
one case only (up to symmetries) giving a linear deterministic context-free language. 


The halting problem for DTM(2,2) is decidable. 


It should be noted that the machine last mentioned is not the beasy beaver machine 
for DT M(2, 2) since that one is the following which can be shown easily: 


It should also be mentioned that in most cases the sets L,(7T,p) and L,(T,p) are 
identical, but that there are some exceptions. 


7. DTM(4, 4) 


Here only a machine accepting a language being not context-free is presented. This 
machine is 


where the open positions are irrelevant and may be filled by M. 
For the accepted language the following fact holds: 


L(T,p) N C)r3 = A) 133020}. 
P P 


showing that Z,(7,p) is not context-free. 

Recently, it has been shown [3] that there exist Turing machines in DTM(2, 5) and 
DTM(3, 6) closely related to Collatz problems with unknown solutions. 

Finally, in 1992 the existence of a universal Turing machine in DTM(3, 10) was 
shown [8], and in 1995 the existence of another one in DTM(18, 2) [9]. 

There exists also an unpublished proof by Pavlockaya on the decidability of the 
halting problem for DTM(3, 2). 


Acknowledgements 


The author thanks the unknown reviewer for careful reading and useful hints. 


M. Kudlek/ Theoretical Computer Science 168 (1996) 241-255 255 
References 


[1] V. Diekert and M. Kudlek, Small deterministic Turing machines, Papers on Automata and Languages, 
Dept. of Math., Karl Marx Univ. of Economics, Budapest, 1988-4, (1989) 77-87. 

[2] G.T. Herman, The Halting problem of one state Turing machines with n-dimensional tape, Z. Math. 
Logik Grundl. Math. 14 (1968) 185-191. 

[3] P. Michel, Busy beaver competition and Collatz-like problems, Arch. Math. Logic 32 (1993) 351-367. 

[4] M.I. Minsky, Size and structure of universal Turing machines using tag systems, in: Recursive Function 
Theory, Symposia in Pure Mathematics Vol. 5 (AMS, Providence, RI, 1962) 229-238. 

[5] M.I. Minsky, Computation. Finite and Infinite Machines (Prentice-Hall, Englewood Cliffs, NJ, 
1967-1972). 

[6] L.M. Pavlockaya, Dostatotnye usloviya razreSimosti problemy ostanovki dlya mašin Tyuringa, Problemy 
Kibernetiki 33 (1978) 91-118. 

[7] Yu.V. Rogozhin, Sem’ universal’nyh mašin Tyuringa, Matematiceskie Issledovaniya 69 (1982) 
76-90. 

[8] Yu.V. Rogozhin, Universal’naya mašina Tyuringa s 10 sostayaniyah i 3 simbolami, Izvestiya Akademii 
Nauk Respubliki Moldova Matematika (10) (1992) 80-82. 

[9] Yu.V. Rogozhin, On the notion of universality and Shannon’s problem for Turing machines, Presented 
at MCU/UMC’9S, Paris. 


[10] S. Watanabe, 5-symbol 8-state and 5-symbol 6-state universal Turing machines, J. ACM 8 (1961) 
476-483. 


